<html>
<head><meta charset="utf-8"><title>playground and mails · t-infra · Zulip Chat Archive</title></head>
<h2>Stream: <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/index.html">t-infra</a></h2>
<h3>Topic: <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html">playground and mails</a></h3>

<hr>

<base href="https://rust-lang.zulipchat.com">

<head><link href="https://rust-lang.github.io/zulip_archive/style.css" rel="stylesheet"></head>

<a name="206606366"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206606366" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206606366">(Aug 11 2020 at 17:42)</a>:</h4>
<p>ok, so I found out that the playground server is configured to send mails with cron</p>



<a name="206606379"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206606379" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206606379">(Aug 11 2020 at 17:42)</a>:</h4>
<p>to <span class="user-mention" data-user-id="116155">@Jake Goulding</span> for monitoring</p>



<a name="206606443"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206606443" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206606443">(Aug 11 2020 at 17:42)</a>:</h4>
<p>that's kind of a problem, since it's failing both spf and dkim (of course)</p>



<a name="206606468"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206606468" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206606468">(Aug 11 2020 at 17:43)</a>:</h4>
<p>so the mail is going to be blocked if we start enforcing dmarc</p>



<a name="206606617"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206606617" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206606617">(Aug 11 2020 at 17:44)</a>:</h4>
<p>man I love emails</p>



<a name="206606684"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206606684" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Jake Goulding <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206606684">(Aug 11 2020 at 17:44)</a>:</h4>
<p>It's really only to have a little tiny visibility</p>



<a name="206606724"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206606724" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Jake Goulding <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206606724">(Aug 11 2020 at 17:45)</a>:</h4>
<p>I think I've checked it once a year or so for some reason</p>



<a name="206606750"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206606750" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Jake Goulding <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206606750">(Aug 11 2020 at 17:45)</a>:</h4>
<p>so we can probably just turn it straight off</p>



<a name="206607001"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206607001" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206607001">(Aug 11 2020 at 17:47)</a>:</h4>
<p>what does cron contain?</p>



<a name="206607067"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206607067" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Jake Goulding <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206607067">(Aug 11 2020 at 17:47)</a>:</h4>
<p><code>pull-from-s3-and-docker-hub &amp;&amp; restart-server</code> (not literally)</p>



<a name="206607232"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206607232" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Jake Goulding <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206607232">(Aug 11 2020 at 17:49)</a>:</h4>
<p>My super advanced deployment</p>



<a name="206607556"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206607556" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206607556">(Aug 11 2020 at 17:51)</a>:</h4>
<p>do you care about receiving a mail every time it runs or just when it fails?</p>



<a name="206607760"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206607760" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Jake Goulding <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206607760">(Aug 11 2020 at 17:53)</a>:</h4>
<p>only on failure is fine. I mostly did it that way so I could be aware of failures that included "you screwed up sending email"</p>



<a name="206610278"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206610278" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206610278">(Aug 11 2020 at 18:11)</a>:</h4>
<p><span class="user-mention" data-user-id="116155">@Jake Goulding</span> then I think the best solution is to move the cronjob to a systemd timer</p>



<a name="206610317"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206610317" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206610317">(Aug 11 2020 at 18:11)</a>:</h4>
<p>and setup prometheus monitoring for it</p>



<a name="206610383"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206610383" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206610383">(Aug 11 2020 at 18:12)</a>:</h4>
<p>so we'll get alerts the same way we do for the other pieces of infra</p>



<a name="206610746"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206610746" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Jake Goulding <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206610746">(Aug 11 2020 at 18:14)</a>:</h4>
<p>Seems believable. I'll do a quick "ugh systemd" just for my health's sake.</p>



<a name="206611163"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206611163" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206611163">(Aug 11 2020 at 18:18)</a>:</h4>
<p>systemd timers are pretty nice tbh</p>



<a name="206683857"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206683857" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206683857">(Aug 12 2020 at 11:43)</a>:</h4>
<p><span class="user-mention" data-user-id="116155">@Jake Goulding</span> configured systemd timers</p>



<a name="206683870"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206683870" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206683870">(Aug 12 2020 at 11:43)</a>:</h4>
<p>currently to run every hour</p>



<a name="206683935"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206683935" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206683935">(Aug 12 2020 at 11:44)</a>:</h4>
<p>you can see the status with:</p>
<div class="codehilite"><pre><span></span><code>sudo systemctl list-timers
</code></pre></div>


<p>and start a manual update with</p>
<div class="codehilite"><pre><span></span><code>sudo systemctl start playground-update.service
</code></pre></div>



<a name="206683949"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/playground%20and%20mails/near/206683949" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/playground.20and.20mails.html#206683949">(Aug 12 2020 at 11:44)</a>:</h4>
<p>alerts will come to the alertmanager topic in the private stream</p>



<hr><p>Last updated: Aug 07 2021 at 22:04 UTC</p>
</html>